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(54) A method and system for updating replicated databases in a telecommunication network 
system 

(57) A method and system for updating a replicated _ 
database of a telecommunications network system is 
disclosed. The database in a network system improves 
cost, setup time and system availability. A call transport 
system lias switches for fonwarding calls from a local tel- 
ephone station through the call transport system to a 
destination. A signaling system is operatively connected 
to the call transport system and includes a primary site 
databases within the signaling system containing cus- 
tomer records for call routing and other signaling func- 
tions and at least one secondary site database contain- 
ing the customer records of the piinnary site database. 
Both primary and secondary site database maintain mul- 
tiple versions of the same customer record so that que- 
ries of a call can use a versbn number to access the 
corresponding version of the record in the same data- 
base for consistent routing and other signaling infonra- 
tlon. A customer record is updated in the primary site da- 
tabase and then information concerning the updated da- 
tabase record is transmitted through the signaling net- 
work to the secondary site database containing the rep- 
licated version of the record. The records are then up- 
dated according to the sequence of the version number. 
The processing of all calls querying the previous versbn 
of the primary and secondary site database record are 
completed before the previous version of the database 
record is deleted. 
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Description 

This application is related to commonly assigned, copending patent application filed on even date by the same 
inventor and entitled. "A Method and System For Updating Replicated Databases In Foreign and Home Telecommuni- 
cations Network Systems For Supporting Global Mobility of Customers.' 

FIELD OF THE INVENTiON 

This Invention relates to a method and system for updating replicated databases in a telecommunications networic 
system to Improve call setup time and system availability. 

BACKGROUND OF THE iNVENTiON 

The Intelligent Networic (IN) and associated Universal Personal Telecommunication (UPT) , and Personal Commu- 
nication Network (PCN) services are becoming more important as the amount of mobile communications and other 
similar telecommunication sen/Ices Increase. In a proposed PCN, for example, a wired information network and a wire- 
less network will be maintained. A PCN would allow a large number of mobile customers to initiate and receive calls 
while moving from one location to another. Customer positions would be tracked and their location Information maintained 
in network databases. 

A proposed method to support terminal mobility requires a home database (or Home Location Register, HLR) and 
a visitor database (or Visitor Location Register. VLR). In a proposed design, the home database is accessed by a fixed, 
wired network while the visitor database is connected to a switch in the wireless network. The routing and other signaling 
functions of each call initiated from or destined for mobile customers requires a use of the information stored in the 
databases. 

Universal Personal Telecommunication services allow personal mobility. In essence, each user can Initiate and 
receive calls by using a unique personal telephone number (referred to as a Personal Telecommunicatran Number, PTN) 
on any fixed or mobile terminal no matter the geographical location of the user. As a result, calls destined for a particular 
PTN can be routed to its customer's home, office, car. or answering service according to the routing plan specified by 
the custoner. Again, the extensive use of signaling databases, i.e., network databases, for call routing and other signaling 
functions is required. 

As these sen/ices become more popular and the traffic load associated with these services grow, the number of 
queries and updates (corresponding to one customer record) to the databases will also increase dramatically. As a 
result, it will be advantageous to distribute and replicate customer records in multiple geographical locations, i.e.. sites, 
of the signaling network for easy access, achieving a high level of efficiency and system availability as well as an improved 
call setup time. 

Typically, the drawback of data distribution and replication is the overhead incurred by the concurrency control 
protocols to maintain the correctness and consistency of records stored at various sites. To allow recovery after system 
failure at different sites, a set of commitment protocols becomes necessary. These commitment protocols not only com- 
plicate the system design, but also add more overhead to the system operations. Thus, there is a trade off between the 
perfomiance gained by data distribution and replication, and loss of efficiency resulting from overhead. 

Some high security computer database systems, such as used by banks, require stringent protocol, e.g., Prima- 
ry-Site Locking (PSL), or when lower security is possible, Basic Time-Stamp (BTS) protocol. A Primary-Site Locking 
system would be necessary in a bank database computer system where any secondary database wouW have to be 
locked until all data is updated and verified as accurate, OthenA^ise, withdrawals could be made spontaneously from two 
different geographic locations even though one withdrawal would delete the account and the second transaction woukJ 
withdraw funds when the account actually had no existing funds. To prevent such occurrences, secondary databases 
are locked until updated so that no withdrawals can occur This could dramatically slow down banking time. 

In telecommunications, however, inconsistency between replicated copies of customer records for a brief period of 
time can be tolerated because the major consequence of accessing obsolete information will be a "call mlsroute". The 
network can allow a small fraction of calls misrouted as long as the number of misrouted calls Is very small compared 
to the overall call volume. 

SUflflMARY OF THE iNVENTiON 

The features and advantages of the present invention overcome using concurrency control protocols such as a 
Primary-Site Locking and Basic Time-Stamp which would add overhead to the system and delay the processing of calls. 

In accordance with the present invention, a method and system for updating replicated databases in a telecommu- 
nicatfons network system to improve call setup time and system availability is disclosed, and othenwise known as a 
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primary writer protocol. The system includes a call transport system having switches for fonwarding calls from a local 
station through the call transport system to a destination. A signaling system is operatively connected to the call transport 
system, and includes a primary site database containing customer records for call routing and other signaling functions, 
and at least one secondary site database containing the replicated customer records of the primary site database. 

In one aspect of the invention, a field is added to each customer record corresponding to a version number of the 
record so as to identify the record referenced by queries of calls in progress. The records are updated in the secondary 
site database by using the version number sequence of the updated database records. Another field is added to the 
record corresponding to a call counter to indicate the number of ongoing calls that previously accessed that version of 
the record. The call counter field is incremented if a new call setup references to it and decremented when the call setup 
is completed. The previous (i.e.. obsolete) database record is deleted when the call counter is zero. 

In still another aspect of the present invention, the updated database record in the primary site database is also 
verified for data inconsistency If there is data inconsistency then the update is discarded and/or the database record 
is updated again from its source before being transmitted to the secondary site database. 

If the customer record is updated in the primary site database successfully, information concerning the updated 
database record is transmitted through the signaling network to the secondary site database containing the previous 
replicated version of the record. Updates at the secondary site database are processed in the sequence of the version 
number. The processing of all calls querying both the primary and secondary site databases are completed before the 
previous version of the database record is deleted. These multiple versions of records are maintained in the primary 
and secondary databases so that queries for a call can access the same version of the associated record for consistent 
routing and other signaling informatbn. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The foregoing features and advantages of the present invention will be appreciated more fully from the following 
description, with reference to the accompanying drawings in which: 

Figure 1 is a block diagram of an illustrative embodiment of the invention showing, a telecommunicatbn service 
using the method and system of the present invention in a wired and wireless network. 

Figure 2 is a timing diagram for the primary writer protocol in accordance with the present invention. 

Figure 3 is a timing diagram for a primary-site kxking protocol. 

Figure 4 is a timing diagram for a basic time-stamp protocol. 

Figure 5 is a graph showing a call misroute for a two-site replication in accordance with the present invention. 
Figure 6 is a graph showing a call misroute for a five-site replication in accordance with the present inventran. 
Figure 7 is a graph showing a call misroute for non-uniform traffic load in accordance with the present invention. 
Figure 8 is a block diagram showing a centralized database for global mobility using the protocol in accordance with 
the present invention. 

Figure 9 is a btock diagram showing the use of distributed, home databases for glot)al mobility. 

Figure 10 is a block diagram showing an extended signaling network with replicated databases for global mobility 

Figures 1 1 A and 1 1 B are flow charts showing the general method of the invention. 

DETAILED DESCRIPTION OF THE INVENTION 

The present invention now allows replicated databases to be updated in a telecommunication network system to 
Improve cost setup time and system availability without the overhead typically associated with such concurrency control 
protocols as primary-site locking and basic time-stamp protocols. 

In accordance with the present inventton, a customer record is updated in a primary site database within the signaling 
system of a telecommunicatbn networi^, which includes a call transport system with switches for fonwarding calls from 
a local telephone station through the call transport system to a destination. The infomiation concerning the updated 
database record is transmitted through the signaling network to at least one secondary site database which contains 
the prevbus repeated version of the primary site database record. The customer record is changed at the secondary 
site to reflect changes in the database at the primary site. The older versions of the record are maintained at both primary 
and secondary site databases for query access until after completing the processing of ail previous calls querying the 
versbns of the record at the database site. 

The replicated database design in accordance with the present invention can also be used to support global mobility 
It can be applied to Universal Personal Telecommunications, Personal Communication Sen/ices (wired and wireless) 
and future global mobility sen/ices offered by Intelligent Networks. The design will provide a significant saving in trans- 
mission facility and operating costs, and minimize delays associated with call setup time. There is a shorter implemen- 
tation time because the design with global implementation is based on current networit infrastructure, requiring deptoy- 
ment of only a small amount of equipment. The design is also consistent with existing protocol standards. 
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The proposed design for global mobility divides the world (besides the U.S.) into several regions typically covering 
several countries. To support global mobility, a single or multiple of home databases are installed in the U. S. and a visitor 
database is installed in each region. A record of signaling data of each customer is stored in the home database. If a 
customer is visiting a foreign country, the customer record is also replicated in the visitor database of the visited region. 
Calls for the roaming customer originated from the U.S. and the visited region can be processed by the home and visitor 
database respectively. Because of local availability of signaling information in the visited region, this design can reduce 
transmission facilities and operating cost. Call setup time and response time of other signaling functions are also lowered. 

Figure 1 illustrates an intelligent network, shown generally at 10, having a transport network, indicated generally at 
12. and signaling network such as the common SS7 network 14. The transport network 12 includes a wired network 
20, and could include a wireless network 16 for mobile units 22. The transport network 12 connects to the local central 
office 23 and the kx:al telephone station 24. 

The signaling network includes at least a primary site 26. which contains database records for routing purposes 
and other signaling functions. A secondary site 28 is geographk^ally spaced from the primary site 26 and includes rep- 
lk:ated database records from the primary site 26. such as the illustrated Record A corresponding to general routing 
and signaling information for a customer. 

For purposes of understanding, a general overall description of the system basics is set forth, followed by more 
detailed specifics. 

Since the distributed database issues are common to the PON, the UPT services, and possibly other services 
involved in the use of databases (e.g., Network Control Points. NCPs) in the IN. the general terminology for distributed 
database systems is adopted in the following specification. The computer system 30, 30a for respective primary and 
secondary sites where parts of the database are located is referred to hereafter as sites. Customer records for call 
routing, features, sen/ice profiles, and other signaling inforniation are called records. Reads and writes to the database 
are also referred to as queries and updates, respectively. To enable recovery from system failures (except disk crashes), 
each site keeps a log (also known as journal) of all updates made to the local database in a stable memory 36. 36a 
which can survive the failures. 

In accordance with the present invention used with telecommunication services, the database 26a consists of a 
collection of individual records, which are distributed and replicated at multiple sites, such as the secondary site database 
28a. Queries associated with a call, and updates for a customer, access a particular record in the database. Thus, the 
readset and writeset of a query and an update are one record. As a result, if queries and updates are processed atom- 
ically, unnecessary data inconsistency can be avoided. 

Furthermore, several queries may be launched to access the associated record during the call setup time, which 
typically lasts several seconds. Although the record may have been updated in the meantime, it is advantageous not to 
immediately remove an obsolete copy of the record so that subsequent queries of the calls in progress can be processed 
in a consistent way according to the previous record. This eliminates the need for locking records for query processing 
without being concerned about data inconsistency. Additionally, calls will not be mishandled while the customer's record 
is updated. This would be more difficult if the readset and writeset of queries and updates consisted of many records 
and files, as in the database systems of other applications. 

Because the readset and writeset consist of one record. It is advantageous to treat records as the "unit" for distribution 
and replication at different sites. 

Since the readset (or writeset) of each query (or update) is one record, the concurrency control protocol must only 
maintain the internal and mutual consistency at the record level. With intemal consistency, data items in each record at 
every site are always consistent. For example, the routing data in a record must be valid so that calls can be routed 
properly. Mutual consistency is presented, if copies of a record replicated at different sites become identical in a finite 
amount of time after a number of updates have been posted to the record. The commitment protocol is designed to 
enable the system to recover from system failures, i.e., those updates that have been committed will not be undone. As 
illustrated below, the present invention provides a single protocol which performs the concun-ency control and the com- 
mitment functions. 

The telecommunications system of the invention has basic operating parameters: 

(1) All sites are connected by a signaling network and messages sent from one site to another may be k>st in the 
network. Even if messages reach their destination sites, they may not necessarily arrive in the order in which they 
are sent. 

(2) Records of the database 26a are distributed and replicated at the sites. For example, a record (record A) is 
replicated at N sites, indexed by i = 1 .2.....N. To take advantage of load balancing, the initial queries of calls requiring 
access to record A are sent to those N sites according to some call distributbn algorithm known to those skilled in 
the art, such as the generalized round-robin algorithm, or a static scheme. To avoid unnecessary data inconsistency 
if a call setup involves multiple queries to the same record, subsequent queries of a call are routed to the same site 
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where the initial query of the call is processed. 

(3) Each site 26, 28 can keep multiple versions of a record so that queries for a call can access the same version 
of the associated record for consistent routing and other signaling information. An obsolete version of the record Is 
deleted after the process of all calls querying it has been completed. 

(4) For recovery purposes, each site records the update activities in a log in stable storage, which can survive the 
system failures considered in this invention. 

For each record A. one site with a copy of the record is selected as its primary site (PS) 26 and all other sites having 
a copy of the same record are referred to as the secondary sites (SS)28. (Note that the PS can also serve as the PS 
for many other records stored at this site. For simple implementations, this is likely the case.) Queries for record A are 
routed to the Primary Site 26 or any of the Secondary Sites 28 according to the call distribution algorithm in use. 

However, all updates for record A are first submitted to and processed by the primary site 26. If the processing of 
an update is completed without causing data inconsistency, the update is committed at the primary site. Then, the 
information relating to the update is sent from the primary site 26 to all secondary site to update all replicated copies of 
the original database record. This concurrency control and commitment protocol is referred to as the Primary Writer 
Protocol (PWP). 

To ensure the correct operations of the protocol, two fields are added to each record: 1) a version number (VN) and 
2) a call counter (CC). The version number is used to identify the version of a record referenced by queries of calls in 
progress, while the call counter indicates the number of ongoing calls, that have previously accessed that version of the 
record. If the call counter is zero, and the record has been updated, the older version of the record is deleted. At any 
given time, there are probably very few (e.g., two) versions of the same record existing at a site because all setup time 
lasts only a few seconds and inter-update time is typically much longer than that. 

For purposes of understanding the details of the present invention, the following notations apply. f{/^(n) is the version 
of record A with the versbn number (VN) being n for n = 0.1,2, and call counter. CC(n) denoting the CC of RA(n). 
Assume that Ra(0) initially exists in the system. Further, let vjate be the VN of the latest version of record A existing 
at a site. U denotes an update to record A, which successfully creates (n). The primary-write protocol of the present 
Invention can be further described as follows. 
If the query for record A is the first query of a call, then 



begin 



Access 



latest 



Ra ( vn_late ) ; ( *Access to the 
version of record A at the 



site*) 

Record the VN, vn_late, for 
CC(vn late) - CC(vn late)+l 



the call; 



end 



else begin 



Access Rs^ (n) that 
previous queries 
If the query is 



has been accessed by 
of the call; 

the last one of the call, 



then 



begin 



CC(n) - CC(n) -1; 

If CC(n)=0 and vn_late>n, then RA(n) is 
deleted 



end 



end 
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The site is assumed to be capable of making the detemnination whether the query is the last one of the call. If the 
site does not have this capability, it is assumed that the site is notified by a separate message upon completion of a call 
processing. In this case, the following operations are performed when such a message is received: 

CC(n)<-CC(n) -l.and 
s if CC(n) = 0 and vn^late >n, then R;^(n) is deleted. 

Checking if CC{n) <0 prior to the operation of CC(n) <- CC(n)-1 can serve as a sanity check since CC(n) ^ 0 by definition. 

Details of processing an update for record A at the PS are as follows: 
If the update does not cause data inconsistency (e.g.. due to incomplete routing data supplied by customers), then 

10 ' begin (*Update committed*) 

Create {vn_late+l) and set vn^late r ^ 
vn_late+l; 

Record the committed update/ Uvnia-.a/in the 



IS 



20 



30 



36 



log; 



If CC(vn_late-l)=0, delete RA(vn_late-l) ; 
Send an update message, 
(U,.n_:ate# vn_late) , to all secondary 
site' s; 

Start a timeout period for the update Uvn 

2s end 

else begin (♦Update aborted*) 

Abort the update and inform the source 
end 



Details of processing an update for record A at a secondary site / are as follows. 
For an update message (U„,n), compare n with vn_late at the site; 

If n>vn_late+l then 

begin (*Updates arrive out of sequence*) 

Add the out -of -sequence update (U.,n) 
to a update list for record A, sorted 



40 



4$ 



SO 
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in the ascending order of 
VN's for future processing 

end 

else if n = vn_late+l then 

begin {*Update with the correct VN*) 

Process a-, create R^di), and set 
vn_late - vn_late 1+1; 
Record the committed update, U.,n ;ate/ in 
the log; 

If CC(vn_late-l)=0, delete RA(vn_late-l) ; 
Send an acknowledgement with the VN 
vn_late and the site number i to the 
PS; 

Repeat this procedure to process the 
first update in the update list for 
record A if its VN equals vn_late+l 

end 

else if n<vn_late then 

begin (*Duplicated update which has been 

previously processed*) 
Send an acknowledgement with the VN n 
and site number i to the PS 

end 

Details of acknowledgement processing for Record A at the PS are as follows. 

If the acknowledgement has been received before, it is discarded; otherwise, the acknowledgement for update 
from site i is recorded in the log; if all acknowledgements associated with have been received from all secondary 
sites 28, the timeout is deactivated and a "completion" message is sent to inform the source that all copies of record A 
have been updated successfully. Processing at Timeout Expiration for Record A at the PS is as follows: 

The update is resent to those sites from which the associated acknowledgements have not been received. 

As noted before, all updates for record A are first processed by the primary sites 26. If an update causes any data 
inconsistency, it will be rejected (aborted) by the primary site 26; othenwise. the update is committed. The protocol of 
the present invention also preserves the internal consistency for all replicated copies of record A. 

I. If the copies of R^ (0) replicated at the primary site 26 and all secondary sites 28 are identical and internally 
consistent, the protocol of the present inventfon maintains the internal consistency for all replicated copies of record A. 

For example, consider a set of updates {Un;n=1,2,3,...} committed at the PS where U„ maps R^Cn-l) to R;^(n). The 
mapping is denoted by RA(n)=U„(RA(n-1 )). Because Ra(0) is consistent and the U^'s are committed by the PS only if 
they cause no inconsistency, the RA(n)=Un(Un. i(,..Ui(Ra(0))...)) for all n=1,2.3.... is always internally consistent at the 
primary site 26. By use of the VN's, the protocol forces the U^'s to be posted at each secondary site 28 in the same 
sequence in which they are committed by the primary site 26. Therefore, the internal consistency at the primary site 26 
implies Internal consistency for record A at all secondary sites 28. 

The mechanism by which the protocol of the present invention maintains record consistency is similar to that for an 
exclusive-writer protocol proposed in W.W. Chu and J. Hellerstein, The Exclusive-Writer Approach To Updating Repli- 
cated File in Distributed Processing Systems." IEEE Transactions on Computers . Volume C-34, No. 6. June 1985, pp. 
489-500, although the latter protocol does not consider the delayed processing of out-of-order update messages, the 
failure recovery aspects and the characteristics of telecommunication applications. It shouW be noted that, once an 
update is committed by the primary site 26, it can always be committed at the secondary sites 28. Thus, there is no 



EP0 702 496 A2 



need fa database rollback. 

The method and system of the present invention also provides mutual consistency. If no additional updates are 
submitted to the system after a number of updates for record A have been sent to the primary site 26, all replicated 
copies of record A at the sites will eventually become identical in a finite time period, provided that all sites are operational, 
perhaps after a failure for a finite amount of time. 

II. If the copies of Ra(0) replicated at the primary site and all secondary sites are identical, the protocol of the present 
invention maintains the mutual consistency for all replicated copies of record A. 

Suppose that updates {U„;n=1,2....,M} have been committed by the primary site and no further updates will be 
submitted. The use of VN's by the system and the method of the present invention forces the updates U^'s to be posted 
at all secondary sites in the sequence in which they are committed at the primary site. Since f^p,{0) is identical at all 
sites, copies of Ra(M), which equals (Um.i( ..Ui(R;^(0))...)). at all sites are identical after updates {Un;n=1,2,. ...M} 
are processed by all sites. 

The system allows non-identical copies of records replicated at different sites to be available for call processing 
simultaneously. Thus, queries may access the obsolete information at some secondary sites while updates are pending 
for processing, thus causing call misroutes. As discussed before, if the probability of such occurrence is satisfactorily 
small, exclusive access to the records during updates is not needed. Without exclusive access, the system 1 0 is deadlock 
free. 

Furthermore, the system 10 does not require extensive message exchanges among sites which would otherwise 
be needed for concurrency control protocols such as locking to provide the exclusive access. Because a record is 
replicated at N sites, the total number of messages exchanged between the primary site and the secondary sites for 
each update is 2(N-1 ) at normal situations. This is the minimum number of message exchanges to support the degree 
of mutual and Internal consistency needed for call routing and signaling. The system and method of the present invention 
can also be used in other applications as long as they can tolerate the record inconsistency, and the probability of 
referencing obsolete data is kept at an acceptable level. 

The system of the present invention also has recovery ability, such as for the following situations, 

a. Loss of Messages and Link Failures: A loss of update and acknowledgement messages will cause the timeout 
to expire on the primary site. When this happens, the primary site resends the update message to the sites associated 
with the k)st messages. 

b. Site Failures: If the primary site fails before an update is committed in the log, the update is simply lost. The 
source discovers that if it does not receive a completion message from the primary site after a certain time period. 
In case the primary site fails after a committed update has been written in the log, the primary site can resume its 
operatfons after the failure as if the update was just written in the log. 

As a result, the update is sent to all secondary sites again. For those secondary sites which have already posted 
the update successfully, they simply discard the duplicated update and send an acknowledgement back to the 
primary site. If a secondary site fails, the primary site resends the update, If any, to the failed site when the timeout 
associated with the update expires. 

After resending the update to a secondary site for a number of times, the primary site may declare the secondary 
site no longer accessible. In this case, other recovery procedures may be taken when the secondary sites resume 
operations. When the failed secondary site recovers, it can also resume its operations as if the last update was just 
written in the log and request the PS to resend all those updates completed during the failure. 

The system and method of the present invention is compared with two commonly used protocols: the Primary-Site 
Locking (PSL) (Figure 3) and the Basic Time-Stamp (BTS) protocols (Figure 4). In addition, jseveral numerical examples 
are presented to portray the typical performance characteristics of the system of the present invention (Figures 5-7). 

A fraction of calls may be misrouted by the method of the present invention because of accessing obsolete infor- 
mation at some secondary site databases, while updates are pending. The fraction of calls misrouted is a key perform- 
ance measure for determining whether or not the method of the present invention Is applicable to a particular application. 

As noted before, a record is first updated at its primary site under the method. A vulnerable period is defined for the 
record at a secondary site as the time interval from the completion of an update to the record at the primary site until 
the time when the update is posted at the secondary site (Figure 2). As the wosX updated record has been available at 
the primary site at the start of the vulnerable period, queries accessing the record at the secondary site during the 
vulnerable period reference obsolete data, thus causing call misroutes. Certainly, such misroutes will not occur, should 
there be no record replfcation. Figure 2 presents a timing diagram for the method of the invention. For example, the 
vulnerable period for update U„ at the secondary site / is from time A to B. 

The length of a vulnerable period mainly depends on two factors: 1 ) the networi< delay incurred by an update mes- 
sage sent from the primary site to the secondary site, and 2) the update response time (Le!, time from the arrival of an 
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update until its processing is cx)mpleted) at the secondary site. These factors in turn depend on the characteristics of 
the signaling network, the design of each database, the traffic load, the ratio of query and update rates, and the service 
scheduling discipline for query and update processing. 

Based on a performance study with typical parameters in today's telecommunication networks, results in Figures 
5-7 show that the fraction of calls misrouted under the method of this invention is satisfactorily small (e.g., less than 
1 (H) for a wide range of expected customer behavior (in temi of call throughput and ratfo of record read-write frequencies 
Rq) in the Personal Communication Networks (PCN), wireless networks, Universal Personal Telecommunicatk>n (UPT) 
sen/Ices and other advanced services to be offered by the Intelligent Networks (IN). 

Furthermore, when the method of this invention is compared with other concurrency control protocols such as the 
primary-site locking and the basic time stamp protocols, Figures 3 and 4 show that since the method of this invention 
avoids extensive message exchanges required by the existing protocols among database sites, it reduces the vulnerable 
periods, thus reducing the call misroutes. 

Referring now to Figures 1 1 A and 1 1 B, there is illustrated a high level flow chart depicting the method of the present 
invention using the primary writer protocol of the present invention. 

As shown in block 100, the customer record at the primary site is first updated. The update is then checked for any 
data inconsistency in block 102. If there is an inconsistency, the update program is terminated in block 104. If there is 
no data inconsistency, the update is then processed in block 106 and a new version of the record is created in block 
108. The update is committed in the log in block 110. The information relating to the update is then transmitted to 
databases at secondary sites in block 112. The secondary site updates by using the version number in block 114. 
Secondary site then creates a new version of the record in block 116. The update is committed in the log at the secondary 
site in block 118. If the call counter of the last version of the record is zero in block 120. then the old database record 
is deleted in block 1 22. Regardless whether the call counter is zero or not, the secondary site sends an acknowledgement 
to the primary site as the update has been successfully processed in block 124. The process continues with the next 
update in block 126. 

Replicated Database Design For Global Mobilttv 

The protocol of the present invention is also adapted for use with a replicated database design for supporting global 
mobility with wired and wireless networi^s, or a combination thereof. 

To support the service, personal, and terminal mobility, the communication network has to store, maintain and 
retrieve customers* mobility information for signaling purposes. This infornnation includes that specified in the reference 
environment of a customer (e.g.. the characteristics of the terminal in use, the sen^ices subscribed, the location data 
and the call routing logic). Thus, a key challenge for the mobility management is to develop an efficient database archi- 
tecture so that the mobility data can be readily available for signaling functions such as call setup and routing. 

The current approach to supporting the terminal mobility requires a home database (or Home Ljocation Registers, 
HLR) and a visitor database (or Visitor Location Registers, VLR). This HLR-VLR architecture actually has been estab- 
lished as an industry standard in the Global System for Mobile Telecommunications (GSM) for Europe and the IS-41 
recommendations for North America. The home database can be accessed by the fixed, wired or wireless network, 
whereas the visitor database is connected to a switch (referred to as the mobile switching center, MSG) in the wireless 
network. The routing and other signaling functions of each call initiated from or destined for a mobile customer requires 
the use of the location information stored in the databases. The protocol and the associated architecture for supporting 
the terminal mobility are well defined, and understood by those skilled in the art. 

The notion of personal and sen/ice mobility is relatively new. As a result, the protocols and the architecture for the 
personal and service mobility are yet to be standardized. The present invention is concerned with a signaling-networt< 
architecture based on replicated database for providing personal and service mobilityXo customers traveling throughout 
the wortd. 

In the following description, two altemative database architectural designs are examined, which might be adopted 
for mobility management. Due to the unique characteristics of global mobility an extended signaling network based on 
replicated databases to support global mobility is proposed. The applicability of the architecture to the personal and 
sen/ice mobility and its compatibility to the industrial standards for terminal mobility Is set forth. The system perfonmance 
and cost considerations for the proposed architecture are also discussed. 

The system and method of the present invention can be applied to customer location information (i.e. , routing data) 
of personal mobility. As explained below, the present invention can easily cover service mobility and reference environ- 
ments, such as Universal Personal Telecommunications (UPT) sen/ices. In order for the IN to support the services, it 
has to rely on the extensive use of databases for call routing and other signaling functtons. Each of the originating and 
receiving ends of a UPT call can be a wireless or wired terminal. 

An example of an existing database architectural design to support the UPT sendees for customers traveling abroad 
is shown in Figure 8. The customer location information is stored in a centralized database 200 physically kx:ated in the 
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U.S. In order to make this design feasible, it requires: 

1. Customers traveling abroad have to register from the visited country so that the network is informed of their 
current locations (e.g., in terms of POTS numbers in wired networks, or mobile station roaming numbers in wireless 
networks). This location information for all customers subscribing to the UPT services is stored in the centralized 
database, which can be supported by a Network Control Point, NCR. Signal transfer points 204 in the U.S. network 
communicate with signal transfer points 206 is country 1, and any other country in 210. Country 1 includes a VLR 
212 connected to a MSC 214 in the wireless network 216. Country 1 also Includes a wired network 218. Country 
n also includes similar elements referenced by prime notation. 

2. Every time a customer changes location, the location data (e.g., a POTS number in a wired network, or a pointer 
in the HLR pointing to the VLR 212 serving the location area, a group of cells, where the user is located in a wireless 
network 216) for the customer in the database is updated. Such database updates can be initiated: a) explicitly by 
customers connected to a wired network, as similar to the current 500 sen^ices, or b) automatically by the wireless 
network at whrch the customers are located. 

3. When a call is destined for a UPT customer located either In the U.S. or abroad, the signaling network queries 
the centralized database 200 for the kx:ation information for call setup and other signaling functions. 

The signaling network using distributed databases for mobility management is shown in Figure 9. In the description 
that follows, elements common to those described in Figure 8 are given the same reference numerals. In this distributed 
database design, customer records are partitioned and stored (but not replicated) at different physical locations, which 
can be interpreted as the customers' home locations 230. For this reason, the distributed database design is also referred 
to as the home database design. Actually, the centralized database design can be viewed as a special case of the 
distributed design where all data Is placed at a single location. On the other hand, the distributed databases offer potential 
advantages over the centralized design such as improved availability, reliability, and the flexibility of load balancing. 

This distributed database design can be used extensively for many sen/ices, e.g., Advanced 800 and Software 
Defined Network (SDN) sen^ices, where customer data for the same service is distributed and stored at multiple NCP 
databases. Although each customer's record is stored at a primary and a secondary NCP for reliability reasons, only 
the primary copy is used for signaling functions at normal conditions and the secondary copy is treated only as a backup 
in case of failures. Thus the systems in use should be classifred as the distributed design. 

The major motivation for such wide use of distributed databases is to overcome the limitation of the processing 
power and memory constraint of each NCP A single or at most a few databases (i.e., NCPs) are needed at the initial 
deployment of a new service. As the service demand grows, additional databases are necessary, thus making the cen- 
tralized database design evolve Into the distributed design. The assumptions and operations for call setup, routing and 
other functions for the distributed database design are identical to those for the centralized database design, as dis- 
cussed above. For a given customer, the signaling networks or switches have the computattonal logk; to determine 
which database among many contains the signaling data for the customer. 

Because a current signaling network provides a very high degree of connectivity, querying the distributed databases 
across the U.S. does not cause unacceptable delays nor incur high costs for call setup and other signaling functions. 
The use of distributed databases will continue to be a viable approach. If the high connectivity is maintained in the future, 
there will not be a need to replicate customer records at multiple places for reducing query delays and associated costs. 
However, this is not the case for signaling In other global areas, as anticipated for supporting gbbal mobility in the future. 
In that situation, replicating customer records at a visitor database located at foreign countries will tower operating costs 
and shorten querying delays, as explained below. 

A signaling network based on replicated databases is shown in Figure 1 0, which illustrates basic use of the replicated 
database of the present invention for use in global nriobllity. Like reference numerals are used for elements common to 
other units of Figures 8 and 9. 

1. Depending on the anticipated traffic load and other engineering considerations, the world (besides the U.S.) is 
divided into several regions, each of which covers a number of foreign countries, such as the illustrated Region A 
246 and Region B 248. 

.2. A pair of visitor databases 250 are installed physically In each region, and connected to the signaling network 
in the U.S., for example, via two additional STPs 252 physically located in that region. The number of STPs installed 
in a region and the number of signaling links connecting the STPs to the U.S. signaling network can be adjusted 
and determined according to the traffic, performance, and reliability requirements. 
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3. In the registration process of a customer visiting a foreign country, a record of location and other related signaling 
information for the customer is set up In the visitor database 250 for the region. This new infomftation will also be 
sent back to update the associate home database 230 In the U.S. As a result, each roaming customer has two 
replicated copies of signaling data: one in the home database in the U.S. and the other in the visitor database 
physically located at or cbse to the visited country. The record in the visitor database will be removed when the 
customer leaves the region. 

The replicated database can be accessed for call setup and other signaling purposes. For call originating from the 
visited country or region and destined for the roaming customers, queries can be launched to the visitor database. Calls 
initiated in the U.S. will query the home database. There are three major advantages for the use of replicated databases: 

1 . Substantial Cost Saving 

Due to local availability of needed customer data, the transmission cost for signaling messages for calls originated 
from the visited country or region can be saved. The saving will be substantial for: a) customers roaming half way 
around the world, b) calls requiring multiple queries into the database, which will likely be the case for advanced 
services in the future, and c) a majority of calls originate from the visited country or region, which will also be the 
case for some business customers. Furthermore, as the number of messages sent over a long distance is decreased, 
the facility cost can also be reduced as fewer transmission facilities (e.g., signaling links) wilt be needed to support 
the same amount of call traffic, 

2. Enhanced Delay Performance 

Call setup time and response times for other signaling functions can be reduced. 

3. Compatibility with Existing Wireless Standards 

The replicated database design Is compatible with the industry standards such as the 18-41 and the GSM specifi- 
cations for wireless networks. The visitor database in a region can be treated as the HLR by the wireless network 
in the visited country. The rest of the standardized protocols for wireless networks remain applicable. Upon receiving 
updates from a local wireless network, the visitor database is responsible for fonA^ardlng the updates to the home 
database in the U.S. to ensure customer data consistency in the home and visitor databases. Hence, the replicated 
database design indeed applies not only to wired services but also to wireless services. 

In accordance with the present invention consistency must be maintained between the replicated copies of customer 
data stored in the home and visitor databases. The system and method of the present invention using the Primary Writer 
Protocol (PWP) can be applied to the home and visitor databases for global mobility. The Primary Writer Protocol of 
the present invention is advantageous because telecommunication applications can tolerate inconsistency between 
replicated records for a short period of time. As noted above, the main consequence of accessing obsolete data is a 
call misroute. The performance analysis of the Primary Writer Protocol of the present invention establishes that the 
misroute probability under the present invention is small for the expected customer behavior in wireless networks and 
IN. The present invention preserves both the internal and mutual data consistency, and also allows the system to recover 
from certain types of failures. The main advantage of the Primary Writer Protocol is its bw overtiead, especially when 
compared with existing protocols for computer systems (e.g., banking systems), which are intended for maintaining 
stronger data consistency at all times. 

Using the Primary Writer Protocol of the present invention to support global mobility, the visitor database and the 
home database is designated as the Primary Site and Secondary Site, respectively for updating purposes. As noted 
above, this arrangement is appropriate because location updates and other changes of signaling information are most 
likely generated from customers, who are roaming in the foreign countries. 

Although the above discussion focuses on the location information for UPT customers, it should be noted that the 
replicated database design actually applies well to sen/be mobility and reference environments. The locatbn inf omnation, 
the services subscribed, and the reference environment are specified on a per customer basis. Thus, the replicated 
database design and the associated protocols can treat the per customer infornnation related to the subscribed services 
and other data items included in the reference environment, in the same way as the kx^ation infomiation. As far as the 
system periomiance of the replbated database design is concerned, the only difference among vark^us data items will 
be their query-to-update ratios (e.g., the ratio of the querying rate to the location update rate for a UPT customer). 

Nevertheless, it is expected that the most frequently updated data item will probably be the location infonriation for 
a mobile customer; the query-to-update ratios for other signaling data items will be higher than that for kx^atioi data. 
As a result, the update algorithm of the present invention will also apply to customer records containing subscribed 
sen^ices. reference environment and other signaling infomnation. 

A factor that may degrade the performance of the replicated design Is the query-to-update ratio. If the ratio is high 
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(i.e.. the customer information is seldom changed), the overhead in updating the replicated records will be minimal. 
Otherwise (e.g., for a mobWe customer moving from location to location), the update overhead can be significant. The 
foltawing strategy will enhance the performance of the replicated design, in such situations. 

A mobile, wireless customer is roaming in a foreign country. As a customer moves from one location area to another, 
the customer location information in the visitor database Is updated frequently. The corresponding customer record in 
the home database is also updated. Thus, the transmission and processing costs for nnaintaining the current location 
information in the home database will be significant, especially if the customer is located far away from the U.S. The 
situation will t^ecome even worse if the customer nrK}ves from location to location without making or receiving calls; i.e., 
no revenue is received to cover the cost Incurred in handling the database updates. 

One way to reduce the overhead for location updates is to maintain the current location information for certain highly 
mobile customers only in the visitor database. The home database, in contrast, contains an identifier pointing to the 
visitor database on which the current location information is stored. (I.e.. the visitor database has the complete record 
of information associated with this roaming customer, and the home database has only partial customer infornnation.) 

As a result, the home database does not need to update the location information every time a customers changes 
its location overseas. Furthermore, calls originated from the U.S.. destined for a customer traveling overseas first re- 
trieves the identifier from the home database and then accesses the current location information in the visitor database 
for call setup and other signaling f unctbns. 

The enhancement approach for keeping complete customer data only In the visitor database not only applies to the 
location information, but also applies to other data items with frequent updates. In addition, the enhancement approach 
should be used on a per customer basis because different customers have different mobility and catling patterns. As 
discussed above, the key parameters for identifying these customers for whom the enhancement scheme may apply 
include: 

1 . The ratio of calls to the customer originated from the visited region to all calls destined for that customer, 

2. The database query-to-update ratio (e.g.. an indication of mobility), and 

3. The ratio of cost for updating the home database (with update requests sent from the visited region) and that for 
remote querying the visitor database for calls originated from the U.S. 

Based on these parameters of each traveling customer, the signaling network can determine whether the enhance- 
ment approach should be applied to the customer (I.e., only the visitor database contains the customer's full record and 
the home database stores only parts of the customer data, which are less frequently updated). In fact, the approach 
can be applied to a customer dynamically on a regular basis, i.e, the network can turn on or off the approach perkxJically 
(e.g., every night) for a traveling customer, depending on the customer's call throughput and update frequency statistics 
during the previous period. 

In accordance with the present invention, the extended signaling network based on replbated database has many 
benefits and can be viewed as a means to globalize the telephone network without actually building transport networks 
in foreign countries, which the telephone companies in the United States often are not allowed or prefer not to do. Yet, 
the replicated database design in effect makes use of foreign networks to support global mobility for network customers. 

The replicated design costs less to implement than other system methods such as the employment of satellites for 
locating mobile customers throughout the world (i.e., global, terminal mobility). More importantly, the system of the 
present inventk^n is based on the current infrastructure of wired and wireless networks, and it confonns with existing 
standards of cellular networks. Thus, the replicated design not only reduces the operating costs and calls setup delay 
when compared with other alterative database designs, but also enables the United States telephone network to offer 
global nrK>bility services to customers sooner. 

The proposed design can also help the U.S. network compete with some foreign telephone companies. The network 
may choose to allow access to the visitor database only by (wired and wireless) networks of existing business partners; 
competitors' networks will not be provided with the signaling information stored and used In the visitor database. 

As a result, for calls originated In a foreign country and destined for a network roaming customer, only networks of 
the company in question are equipped to carry the calls. Such an arrangement can also be used to enhance the U.S. 
network's position in partnering with service providers overseas. In another business arrangement, the telephone net- 
work may also choose to furnish, for a fee, some foreign carriers with certain signaling Information to carry calls destined 
for the network customers traveling in the country. Furthermore, if the telephone network can work with its business 
partners abroad, the replicated database design can be implemented in an altemative way. 

If an arrangement between the telephone network and its business partner overseas can be made, instead of in- 
stalling network visitor database and STPs In a foreign country, records of network customers traveling in the country 
can be downloaded directly from the home database to a database In the partner's network. Consequently, as in the 
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original replicated database design, each traveling customer continues to have two copies of his or her information for 
signaling purposes. The protocols and operations for the replicated design remain applicable to this new setting, although 
a United States telecommunications network does not physically own visitor databases and STPs in that country. 

it is to be understood that the above description is only one preferred embodiment of the invention. Numerous other 
arrangements may be devised by one skilled in the art without departing from the scope of the invention. 



Claims 

1. A method for updating a replicated database in a telephone network system to Improve call setup time and system 
availability comprising the steps of 

updating the customer record in a database contained in a primary site within the signaling system of a tele- 
phone network, wherein the telephone network includes a call transport system with switches for fonwarding calls 
from a beat telephone station through the call transport system to a destination. 

transmitting information concerning the updated database record through the signaling network to at least one 
secondary site database which contains the replicated version of the primary site database record. 

adding a field to the database record corresponding to a version number of the database record so as to 
identify the versions of the records referred by queries of calls in progress, and 

changing the database record at the secondary site to reflect changes in the database at the primary site by 
using the version number sequence of the updated database records, while maintaining at all database sites the 
older version of the database record for query access until after completing the processing of all previous calls 
querying the version of the database record. 

2. The method according to claim 1 including committing the updated record of the primary and secondary site data- 
bases by recording the updated record activity in a log in a stable data storage area after the updated database 
record has been processed and committed at the primary and secondary sites respectively. 

3. The method according to claim 1 including sending an acknowledgement from the secondary site database back 
to the primary site database when an updated database record has been processed within the secondary site. 

4. The method according to claim 1 including starting a time-out period when the primary site sends infomiation con- 
ceming the updated database record to all secondary site databases. 

5. The method according to claim 4 including the step of resending information concerning the updated record to the 
secondary site databases again if an acknowledgement of processing completion is not received from the site prior 
to the expiratk>n of the timeout. 

6. The method according to claim 1 including sending an acknowledgment with the verston number of the associated 
record and the identification of the secondary site database to the primary site, when informatbn concerning an 
updated database record is received by the secondary site in duplication. 

7. The method according to claim 1 including storing information concerning an updated database record for future 
processing at a secondary site, if processing of the information leads to a new version of the associated record with 
an out-of-sequence version number. 

8. The method according to claim 1 including discarding acknowledgments at the primary site, if they are received in 
duplication. 

9. The method according to claim 1 including deleting the previous database record version at the all database sites 
after completing the processing of all calls querying the previous version of the database record. 

10. The method according to claim 1 including nr^aintaining multiple versbns of records in the primary and secondary 
databases so that queries for a call can access the same versbn of the associated record in the same database 
for consistent routing and signaling information. 



11. The method according to claim 1 including adding a field to the record corresponding to a call counter to indbate 
the number of ongoing calls whose queries have previously accessed that version of the record. 
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12. The method according to claim 1 1 including incrementing the call counter field by one if a new call references to it, 
and decrementing the call counter field by one when a call setup is completed. 

13. The method according to claim 12 including deleting the previous version of the database record when the call 
counter is zero. 

14. The method according to claim 1 including the step of verifying the updated database record in the primary site 
database for data inconsistency. 

15. The method according to claim 1 wherein the call transport system includes a wireless phone network and a wired 
phone network. 

16. A system for updating replicated databases in a telephone network system to improve call setup time and system 
availability comprising 

a call transport system having switches for fonwarding calls from a local telephone station through the call 
transport system to a destination, 

a signaling system operatively connected to the call transport system, and including a primary site database 
within the signaling system containing customer records for call routing and other signaling functions and at least 
one secondary site database containing at least some of the customer records of the primary site database. 

means for updating a customer record in the primary site database, 

means for transmitting information conceming the updated database record through the signaling network to 
the secondary site database containing the previous version of the database record, and 

means responsive to the completion of all calls querying the previous version of both primary and secondary 
database records for deleting the prevbus version of the database record. 

17. The system according to claim 16 including storage means for recording updated record activity after the updated 
database record has been processed at the primary and secondary sites. 

18. The system according to claim 1 6 including means for sending an acknowledgement from the secondary site data- 
base back to the prinrary site database after an updated database record has been processed within the secondary 
site database. 

19. The system according to claim IB including means for maintaining multiple versions of customer records in the 
primary and secondary databases so that queries for a call can access the same version of the associated record 
in the same database for consistent routing and signaling information. 

20. The system according to claim 16 wherein each updated record includes an identifying field corresponding to a 
versbn number of the record so as to identify the record referenced by queries of calls In progress. 

21. The system according to claim 20 including means for updating the records in the secondary site database by the 
versbn number sequence of the updated database records. 

22. The system according to claim 1 6 wherein each updated record includes a call counter fie W for indicating the number 
of ongoing calls whose queries have prevfously accessed that versbn of the record. 

23. The system according to claim 22 including means for incrementing the call counter field if a new call references to 
it, and means for decrementing the call counter fieki when a call setup is completed. 

24. The system according to claim 23 including means for deleting the previous version of the database record when 
the call counter is zero. 

25. The system according to claim 16 wherein said call transport system includes a wireless phone network and a wired 
phone network. 
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FIG. 7 
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FIG. IIB 
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